loading factor
Learning Nonlinear Factor Models with Unknown Monotone Links from Incomplete and Noisy Data
Chao, Yutong, Gökhan, Resat, Etesami, Jalal, Habibnia, Ali
We study a nonlinear factor model in which observed responses depend on low-rank latent factors through an unknown monotone link function. This setting is challenging and largely underexplored due to severe nonconvexity and identifiability issues. The link function is assumed to lie in a reproducing kernel Hilbert space (RKHS), enabling flexible nonparametric modeling while preserving identifiability. We formulate the problem as the joint recovery of the low-rank factors, loadings, and the nonlinear link function from possibly incomplete and noisy observations and propose a projected block coordinate descent (BCD) algorithm with explicit regularization to address scale and rotational ambiguities. Under mild incoherence of factors and standard sampling conditions, we establish convergence guarantees in both noiseless and noisy regimes, along with sublinear regret bounds for the link-function updates. Our results extend classical linear factor models to a broad nonlinear regime and provide a principled framework for learning nonlinear latent structures. We evaluate the proposed approach using controlled synthetic experiments, indicating promising performance.
ASURA-FDPS-ML: Star-by-star Galaxy Simulations Accelerated by Surrogate Modeling for Supernova Feedback
Hirashima, Keiya, Moriwaki, Kana, Fujii, Michiko S., Hirai, Yutaka, Saitoh, Takayuki R., Makino, Junnichiro, Steinwandel, Ulrich P., Ho, Shirley
We introduce new high-resolution galaxy simulations accelerated by a surrogate model that reduces the computation cost by approximately 75 percent. Massive stars with a Zero Age Main Sequence mass of about 8 solar masses and above explode as core-collapse supernovae (CCSNe), which play a critical role in galaxy formation. The energy released by CCSNe is essential for regulating star formation and driving feedback processes in the interstellar medium (ISM). However, the short integration timesteps required for SNe feedback present significant bottlenecks in star-by-star galaxy simulations that aim to capture individual stellar dynamics and the inhomogeneous shell expansion of SNe within the turbulent ISM. Our new framework combines direct numerical simulations and surrogate modeling, including machine learning and Gibbs sampling. The star formation history and the time evolution of outflow rates in the galaxy match those obtained from resolved direct numerical simulations. Our new approach achieves high-resolution fidelity while reducing computational costs, effectively bridging the physical scale gap and enabling multi-scale simulations.
Understanding the link between PCA and Eigenvectors
In my former article, I've been introducing the concept of Principal Components Analysis, a powerful technique used in Machine Learning to reduce the dimensionality of your input data. An important mathematical feature of PCA is its link with the Eigenvectors (and Eigenvalues) of the original features matrix X, and in this article, I'm going to show the ratio behind this link. So let's start with a brief recap of PCA. Differently from features selection techniques, PCA does not use a subset of the initial features: it rather computes a new set of features obtained as linear combinations of the original ones, living in a lower-dimensional space. Where M is at most as big as p, but of course, because of the purpose of the task (dimensionality reduction), it is chosen to be less than p. The coefficients of the first 2 lines are known as loading factors and are computed in such a way that these new variables are uncorrelated and most of the information within the initial variables is stored into the first components.
Joint Tensor Factorization and Outlying Slab Suppression with Applications
Fu, Xiao, Huang, Kejun, Ma, Wing-Kin, Sidiropoulos, Nicholas D., Bro, Rasmus
We consider factoring low-rank tensors in the presence of outlying slabs. This problem is important in practice, because data collected in many real-world applications, such as speech, fluorescence, and some social network data, fit this paradigm. Prior work tackles this problem by iteratively selecting a fixed number of slabs and fitting, a procedure which may not converge. We formulate this problem from a group-sparsity promoting point of view, and propose an alternating optimization framework to handle the corresponding $\ell_p$ ($0